Evaluating Machine Reading Systems through Comprehension Tests
نویسندگان
چکیده
This paper describes a methodology for testing and evaluating the performance of Machine Reading systems through Question Answering and Reading Comprehension Tests. The methodology is being used in QA4MRE (QA for Machine Reading Evaluation), one of the labs of CLEF. We report here the conclusions and lessons learned after the first campaign in 2011.
منابع مشابه
Psycholinguistic Ambiance of Short Stories in Enhancing Students’ Reading Comprehension and Vocabulary Power
Abstract The present study was carried out to investigate the effect of short stories on students’ reading comprehension, vocabulary power and attitude towards the skill and the new instructional materials. The participants of the study were 120 grade 9 students of Dilla Secondary and preparatory school. In order to gather data for the study, pre- and posttest of reading comprehension, pre and ...
متن کاملPsycholinguistic Ambiance of Short Stories in Enhancing Students’ Reading Comprehension and Vocabulary Power
Abstract The present study was carried out to investigate the effect of short stories on students’ reading comprehension, vocabulary power and attitude towards the skill and the new instructional materials. The participants of the study were 120 grade 9 students of Dilla Secondary and preparatory school. In order to gather data for the study, pre- and posttest of reading comprehension, pre and ...
متن کاملThe Effect of Portfolio Assessment on EFL Learner’s Reading Comprehension Ability
Reading skill is a fundamental requirement to lifelong learner success, yet the way teachers assess their student’s reading comprehension ability is challenging. One of the new trends in reading skill instruction is portfolio assessment. This study investigated the effects of portfolio assessment on EFL learner’s reading comprehension ability. The participants, 50 advanced (female) EFL learners...
متن کاملThe Effect of Awareness Raising Through Metacognitive Strategy-based Instruction on ESP Learners’ Reading Comprehension
The present study was an attempt to investigate the effect of meta-cognitive strategy (planning, self-monitoring) awareness raising instruction on reading comprehension of Iranian ESP learners. Participants of three groups each comprising of 21 Iranian male students studying “Civil Engineering” in “Islamic Azad University of Buin Zahra” were selected and assigned to three groups: two experiment...
متن کاملThe effect of task-based instruction on reading comprehension of Iranian EFL learners
Developing reading comprehension ability is an important aspect in acquisition of a language. The present study focused on improving reading comprehension ability through Task-based Instruction (TBI). TBI is a methodology that develops from a focus on classroom tasks. The participants of the study were 135 Iranian female students at different levels selected from high sc...
متن کامل